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Abstract 

If a two-player social welfare maximization problem does not admit a PTAS, we prove that 
any maximal-in-range truthful mechanism that runs in polynomial time cannot achieve an ap- 
proximation factor better than 1/2. Moreover, for the /c-player version of the same problem, the 
hardness of approximation improves to 1/k under the same two-player hardness assumption. 
(We note that 1/k is achievable by a trivial deterministic maximal-in-range mechanism.) This 
hardness result encompasses not only deterministic maximal-in-range mechanisms, but also all 
universally-truthful randomized maximal in range algorithms, as well as a class of strictly more 
powerful truthful-in-expectation randomized mechanisms recently introduced by Dobzinski and 
Dughmi. Our result applies to any class of valuation functions that satisfies some minimal 
closure properties. These properties are satisfied by the valuation functions in all well-studied 
APX-hard social welfare maximization problems, such as coverage, submodular, and subadditive 
valuations. 

We also prove a stronger result for universally-truthful maximal-in-range mechanisms. Namely, 
even for the class of budgeted additive valuations, which admits an FPTAS, no such mechanism 
can achieve an approximation factor better than 1/k in polynomial time. 



1 Introduction 



Do computational problems become harder when the inputs are supplied by selfish agents and the 
algorithm is required to operate in a way that incentivizes truth-telling? This question has been 
central to algorithmic mechanism design since the field's inception [14]. The most famous positive 
result in the area is also one of the simplest: any efficient social- welfare-maximization algorithm can 
be transformed into a computationally efficient truthful mechanism using the celebrated VCG pay- 
ment scheme [61 \TT\ [T7] . It is also well known that this result does not extend to approximation al- 
gorithms: in order for an algorithm to be truthfully implemented by the VCG payment scheme, the 
algorithm must satisfy a property known as maximal-in-range (MIR) |15j . which is unfortunately 
violated by most approximation algorithms. However, the technique of combining a maximal-in- 
range algorithm with the VCG payment scheme remains the only known general-purpose technique 
for designing truthful mechanisms for multi-parameter domain^], and consequently a great deal of 
research has been devoted to searching for computationally efficient approximation algorithms that 
are maximal-in-range, e.g. [9j I10|, [T2] . or proving hardness-of-approximation theorems for this class 
of algorithms, e.g. [51 [T3| [T6]. 

Combinatorial auctions are the most well-studied, and arguably the most important, class of 
mechanism design problems, and they furnish striking insights into the capabilities and limitations 
of maximal-in-range mechanisms. One can bound the approximation ratio of a combinatorial 
auction mechanism in terms of many parameters, including the number of players (henceforth 
denoted by k) or the number of items (henceforth, m). A particularly bleak picture emerges when 
one bounds the approximation ratio in terms of the number of players. Any combinatorial auction 
with k players has a trivial mechanism that simply packages all the items as a single bundle and 
awards this bundle to the bidder who values it most highly. This mechanism is computationally 
efficient, maximal in range, but only achieves approximation ratio 1/k. Despite years of research 
on truthful combinatorial auctions, to our knowledge this dependence on k can be improved in 
only one combinatorial auction domain: the domain of multi-unit auctions. Here, the underlying 
social welfare maximization problem admits a deterministic FPTAS that is not maximal-in-range. 
Dobzinski and Nisan [9j discovered a deterministic 2-approximation that is MIR, and Dobzinski 
and Dughmi [7J discovered an FPTAS that outputs a randomized allocation satisfying a property 
called maximal in distributional range (MIDR). In fact, the Dobzinski-Dughmi mechanism satisfies 
a stronger property that we call maximal in weighted range (MIWR), meaning that the only use of 
randomization is to cancel the allocation (i.e., allocate no items) with some probability. 

1.1 Our contributions 

In this paper we show that there is an inherent reason why truthful mechanisms cannot break the 
barrier" for combinatorial auctions: any approximation hardness at all in the underlying social 
welfare maximization problem is amplified to (1/k + e) -hardness when one restricts the algorithm to 
be maximal in range. In fact, our result extends to two classes of randomized MIDR mechanisms: 
those that choose an allocation deterministically and then toss coins to decide whether to cancel the 
allocation (MIWR mechanisms) and those that toss coins to choose a deterministic MIR mechanism 
and then run it (randomized MIR mechanisms), as well as the combination of the two. Our result 
applies to any class of valuations that is regular, meaning that it satisfies some natural closure 

A multi-parameter domain is one in which an agent's private information consists of more than just a single 
real-valued parameter. 
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properties to be specified in Section [2j These properties are satisfied by the valuation functions 
in all well-studied APX-hard social welfare maximization problems, such as coverage, submodular, 
XOS, and subadditive valuations. 

Theorem 1.1. LetC be any regular class of valuations such that two-player social welfare maximiza- 
tion with valuations in C does not admit a PTAS. Then for all e > 0, there is no polynomial-time 
randomized MIWR mechanism that achieves an approximation ratio greater than 1/k + e unless 
NP C P/poly. 

Even when social welfare maximization over C admits an FPTAS, it may still be possible to 
prove that maximal-in-range mechanisms cannot improve on the trivial 1/k approximation factor. 
In fact, we are able to show this for an important class of valuations that admits an FPTAS: the 
class of budgeted additive valuations, in which each player i has a budget Bi, and her value for a 
bundle is equal to the sum of her values for the individual items, or to Bi, whichever is smaller. 
However, unlike Theorem 13.11 this hardness result is limited to universally-truthful randomized 
maximal-in-range mechanisms. 

Theorem 1.2. For all e > 0, no polynomial-time randomized MIR mechanism for combinatorial 
auctions with budgeted additive valuations can achieve an approximation ratio greater than l/k + e, 
unless NP C P/poly. 

1.2 Our techniques 

A paradigm for proving hardness results of this sort was introduced by Papadimitriou, Schapira, 
and Singer in [16]. To prove that a certain approximation ratio cannot be achieved by maximal- 
in-range mechanisms, one proves that the underlying social welfare maximization problem exhibits 
a particularly strong form of self-reducibility: any maximal-in-range algorithm for optimizing over 
a sufficiently large subset of allocations can be transformed into an algorithm for optimizing over 
all allocations of a smaller set of items. The technical core of any such proof is a lemma showing 
that any sufficiently large range of allocations must "shatter" a fairly large subset S of the items, 
meaning that there is a set of players P such that all allocations of S to P occur in the range. 
In [16] the relevant shattering lemma was the famous Sauer-Shelah Lemma. But since the Sauer- 
Shelah Lemma is a statement about collections of a subsets of a ground set U, and the range of a 
combinatorial auction is a collection of partial functions from U to the set of players, we require 
new shattering lemmas that apply to partial functions. 

Extending the Sauer-Shelah Lemma to partial functions is far from trivial: a lower bound on the 
cardinality of the range does not suffice to prove that it shatters a large set of items; for example, 
the set of all allocations that give a subset of the items to player 1 and no items to any other player 
constitutes an exponentially large range but does not shatter any nonempty set of items. Thus, 
one needs to carefully define what is meant by the hypothesis that the range is "large", and also 
(in the case of more than two players) what is meant by the conclusion that it "shatters" a large 
set of items. In this paper, we provide two such lemmas. In both of them, U and V are finite sets 
with |J7| = m, \ V\ = k, and R is a set of functions from U to V U {*}. 

Lemma 1.3. Suppose that for a random f : U — > V , with probability at least 7 there is a g £ R 



subset S C U of cardinality at least 5m (where 5 > may depend on 7, e,q,k) and a subset T C V 
of cardinality q, such that every function from S to T occurs as the restriction of some g E R. 




most 




elements x & U. Then there is a 



2 



Lemma 1.4. Suppose that e,a,£ are constants such that \R\ > e am , and suppose that for every 
t-tuple of functions g%, . . . ,g# G R, for some 1 < i < j < I there are at least em elements x G U 
such that gi(x) and gj(x) are distinct elements of V . Then there is a subset S C U of cardinality 
at least 5m (where 5 > may depend on e, a,£,k) and a pair of elements a,b G V , such that every 
function from S to {a, b} occurs as the restriction of some g G R. 

The first lemma, which underlies our proof of Theorem 13. II and may be of independent interest, 
substitutes an assumption that R has small covering radius in the Hamming metric in place of the 
usual assumption that R has large cardinality. The second lemma, which underlies our proof of 
Theorem 11.21 generalizes and closely parallels a related lemma from |13| . We prove both lemmas 
in Appendix El 

To derive the lower bound for MIWR mechanisms, an additional idea is needed: rather than 
reducing directly converting an a-approximate MIR algorithm into an exact optimization algorithm 
over a smaller set of items, we convert an (a — <5)-approximate MIWR algorithm into an (a + 5)- 
approximate MIWR algorithm over a smaller set of items, and then we reach a contradiction by 
taking a to be the supremum of the approximation ratios achievable by polynomial-time MIWR 
mechanisms. Translating this idea into a rigorous proof requires a delicate induction over the 
number of players. Finally, to extend the result to randomized MIWR mechanisms, we show that 
any randomized MIWR mechanism can be transformed into a MIWR mechanism with polynomial 
advice, incurring a negligible loss in the approximation factor. The proof of this step closely parallels 
Adleman's proof that BPP CP/ poly. 

1.3 History of these results 

Our work builds on the work of [13] , which obtained a weaker version of Theorem 11.21 also using 
the "shattering" technique. Independently and concurrently with our discovery of Theorem 11.21 
a different proof of a similar result (limited to deterministic mechanisms, but obtaining optimal 
dependence on the number of items as well as players) was discovered by Buchfuhrer and Umans [5]. 
Our Lemma IA.51 which constitutes a step in the proof of Theorem 13.11 and was discovered after 
we had read the proof of the Buchfuhrer-Umans result, uses a counting argument similar to their 
proof of a seemingly unrelated shattering lemma in [5] . 

2 Preliminaries 

We assume the reader is familiar with standard terminology and notation regarding truthful mech- 
anisms and approximation algorithms. Appendix [D] contains the relevant definitions. 

2.1 Combinatorial Auctions 

In a combinatorial auction there is a set [m] = {1, 2, . . . , m} of items, and a set [k] = {1, 2, . . . , k} 
of players. Each player i has a valuation function vi : 2^ — > R + that is normalized (i>i(0) = 0) and 
monotone (vi(A) < Vi(B) whenever A C B). 

An allocation of items M to the players TV" is a function S : M — > N U {*}. Notice that we do 
not require all items to be allocated. If an allocation S allocates all items - i.e. S maps M into iV - 
we say S is a total allocation. The allocation that allocates no items is called the empty allocation. 
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For convenience, we use S(j) to denote the player receiving item j, and we use Si to denote the 
items allocated to player i. We use X(M,N) to denote the set of all alocations of M to N. 

In combinatorial auctions, the feasible solutions are the allocations <Y([m], [k]) of the items to 
the players. The social welfare of such an allocation S is defined as Y^i v i(^i)- When the players 
have values {i>i}i, we often use v(S) as shorthand for the welfare of S. The goal in combinatorial 
auctions is to find an allocation that maximizes the social welfare. 

2.2 Valuation Classes 

The hardness of designing truthful combinatorial auction mechanisms depends on the allowable 
player valuations. Recall that a valuation over M is a function v : 2 M — > M + . We let V denote the 
set of all valuations over all abstract finite sets M. A valuation class C is a subset of V. Examples of 
valuation classes include submodular valuations, subadditive valuations, single-minded valuations, 
etc. Our first result applies to any valuation class that satisfies some natural properties. 

Definition 2.1. We a say a valuation class C is regular if the following hold 

1. Every valuation in C is monotone and normalized. 

2. The canonical valuation on any singleton set is in C. Namely, for any item a the valuation 
v : 2W -> R + , defined as v({a}) = 1 and t>(0) = 0, is in C. 

3. Closed under scaling: Let v : 2 M — ► R + be in C, and let c > 0. The valuation v' : 2 M — > M. + , 
defined as v'(A) = c ■ v(A) for all A C M, is also in C. 

4- Closed under disjoint union: Let M\ and M 2 be disjoint sets. Let the valuations v\ : 2 Ml — > 
M + and V2 ■ 2 M ' 2 — > M + be inC. Their disjoint union v% = v± ®V2 ■ 2 MlUM2 — > M + ; defined as 
v 3 (A) = vi(A n Mi) + v 2 (An M 2 ) for all A C Mi U M 2 , is in C. 

5. Closed under relabeling: Let M\,M 2 be sets with a bijection f : M 2 — » M\. If v\ : 2 Ml — > 1R + 
is in C, then the valuation v 2 : 2 Mi — > M + defined by v 2 (S) = vi(f(S)) is also in C. 

Note that all regular valuation classes support zero-extension. More formally, let M C M', and 
let v : 2 A/ M+ be in C. The extension of v to M', defined as v'{A) = v(A n M) for all A C M', 
is also in C. In the context of combinatorial auctions, we use C m to denote the subset of valuation 
class C that applies to items [m]. 

Most well-studied valuation classes for which the underlying optimization problem is APX-hard 
are regular. This includes submodular, subadditive, coverage, and weighted-sum-of-matroid-rank 
valuations. However, two interesting counter-examples come to mind: multi-unit (where items are 
indistinguishable), and single-minded valuations. Nevertheless, the underlying optimization prob- 
lem is not APX hard for multi-unit valuations, and for single-minded valuations the computational 
hardness of approximation is l/k 1 ~ t even without the extra constraint of truthfulness (see [4]). 

Our second hardness result pertains to deterministic mechanisms for a very simple, non-regular 
class: budgeted additive valuations. This is despite the fact that the underlying /c-player optimiza- 
tion problem admits an FPTAS [2]. Budgeted additive valuations are defined as follows. 

Definition 2.2. We say a valuation v : 2 M — > R + is budgeted additive if there exists a constant 
B > (the budget) such that v(A) = mm(B,^2 i&A v({i})). 
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2.3 MIR, Randomized MIR, MIDR, and MIWR 



Maximal in range (MIR) algorithms were introduced in [15j as a paradigm for designing truthful 
approximation mechanisms for computationally hard problems. An algorithm A is maximal-in- 
range if it induces a maximal-in-range allocation rule when k and m are fixed. 

Definition 2.3. A k-bidder, m-item allocation rule f is maximal-in-range (MIR) if there exists a 
set of allocations 1Z C Af([m], [k]), such that Vt>i, . . . f(v\, v^) £ argmax^g^ Ejt^Sj). 

A generalization of maximal-in-range that uses randomization sometimes yields better algo- 
rithm. An algorithm A is randomized maximal-in-range if it induces a maximal-in-range allocation 
rule for every realization of its random coins. It is well known a randomized MIR algorithm can 
be combined with the VCG payment scheme to yield universally truthful mechanisms. 

Dobzinski and Dughmi defined a generalization of randomized maximal-in-range algorithms 
in [TJ, termed maximal-in-distributional-range (MIDR). Here, each element of the range is a dis- 
tribution over allocations. The resulting mechanism outputs the distribution in the range that 
maximizes the expected welfare, and charges VCG payments. 

Definition 2.4. / is maximal-in-distributional-range (MIDR) if there exists a set T> of distribu- 
tions over allocations such that for all v±, . . . , Vk, f(vi,...,Vk) is a distribution D £ T> that maximizes 
the expected welfare of a random sample from D. 

MIDR algorithms were used in [7J to obtain a polynomial-time truthful-in-expectation FPTAS 
for multi-unit auctions, despite a lower bound of 2 on polynomial-time maximal-in-range algo- 
rithms. Moreover, they exhibited a variant of multi-unit auctions for which an MIDR FPTAS 
exists, yet no deterministic (or even universally truthful) polynomial time mechanism can attain 
an approximation ratio better than 2. Notably, the MIDR algorithms presented in [7] are of the 
following special form. 

Definition 2.5. / is maximal in weighted range (MIWR) if f is MIDR, and moreover each 
distribution D in the range of f is a weighted allocation: There is a pure allocation S £ X{[m\, [k]) 
such that D outputs S with some probability, and the empty allocation otherwise. 

We denote a weighted allocation that outputs S with probabiliby w by the pair (w, S). When 
there is room for confusion, we use the term pure allocation to refer to an unweighted allocation. 

Our first result will apply to all polynomial time MIWR mechanisms, and is the first such 
negative result. In fact, this result also applies to any randomization over MIWR mechanisms, 
a class we term randomized MIWR mechanisms. Randomized MIWR mechanisms include all 
universally-truthful randomized MIR mechanisms as a special case. Our second result will apply to 
only randomized maximal-in-range mechanisms, yet applies to a very restricted class of valuations, 
namely budgeted- additive valuations. 

2.4 Some Complexity Theory 

Broadly speaking, our proof involves constructing a reduction that transforms every instance of a 
fc-player mechanism design problem into an instance of one of k other problems V\, . . . ,Vk, each 
of which individually is presumed to be computationally hard. The reduction has the property 
that input instances with a given number of items, m, are all transformed into inputs of the same 
problem Vi, but instances with a different number of items may map to a different one of the k 
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problems. This raises difficulties because the complexity of Vi,...,Vk rnay be "wild": for each 
of them, there may be some input sizes (perhaps even infinitely many) that can be solved by a 
polynomial-sized Boolean circuit. In this section we develop the relevant complexity-theoretic tools 
to surmount this obstacle. We relegate the proofs of these results to Appendix O 

Definition 2.6. A set S C N is said to be complexity-defying (CD) if there exists a family of 
polynomial- sized Boolean circuits {C n } n <=N such that for all n G S, the circuit C n correctly decides 
3SAT on all instances of size n. 

A set T C N is said to be polynomially complexity-defying (PCD) if there exists a complexity- 
defying set S and a polynomial function p(n) such that T C \J n&s [n,p(n)]. Here [a,b] denotes the 
set of all natural numbers x such that a < x < b. If a set U CN is not PCD, we say it is non-PCD. 

Lemma 2.7. A finite union of CD sets is CD, and a finite union of PCD sets is PCD. 

Definition 2.8. A decision problem or promise problem is said to have the padding property if 
for all n < m there is a reduction that transforms instances of size n to instances of size m, 
running in time poly(m) and mapping "yes" instances to "yes" instances and "no" instances to 
"no" instances. Similarly, an optimization problem is said to have the padding property if for all 
n < m there is a reduction that transforms instances of size n to instances of size m, running in 
time poly(m) and preserving the optimum value of the objective function. 

Lemma 2.9. Suppose that C is a decision problem or promise problem that has the padding property 
and is NP-hard under polynomial-time many-one reductions. Let T be any subset ofN. If there is 
a polynomial- sized circuit family that decides C correctly whenever the input size belongs to T, then 
T is PCD. 

Lemma 2.10. J/N is PCD, then NP C P/poly. 

2.5 Technical Assumptions For Main Result 

For our main result, a note is in order on the representation of valuation. Our results hold in 
the computational model. Therefore, we may assume that valuation functions are succint, in that 
they are given as part of the input, and can be evaluated in time polynomial in the length of their 
description. Naturally, our main result applies to non-succint valuations with oracle access, when 
the resulting problem admits a suitable reduction from an APX hard optimization problem. 

Moreoever, due to the generality of our main result, we need to make some technical assump- 
tions. Namely, we restrict our attention to Combinatorial Auctions over a well-behaved family of 
instances. This restriction is without loss of generality for all well-studied classes of valuations 
for which the problem is APX-hard, such as coverage, submodular, etc. A family J of inputs to 
Combinatorial auctions is well-behaved if there exists a polynomial b(m) such that for each input 
(k, m, v\, . . . , Vk) £ J, the function V{ is represented as a bit-string of length 0(b(m)), and moreover 
always evaluates to a rational number with 0(b(m)) bits. While we believe this assumption may be 
removed, we justify it on two grounds: First, every well-studied variant of combinatorial auctions 
that is APX hard is also APX hard on a well-behaved family of instances, so this restriction is 
without loss for all such variants. Second, this assumption greatly simplifies our proof, since it 
allows us to describe the size of an instance by a single parameter, namely m. 
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3 Amplified Hardness for APX-Hard Valuations 



In this section, we prove the following main result. 

Theorem 3.1. Fix a regular valuation class C for which 2-player social welfare maximization is 
APX-hard. Fix a constant k > 1. For any constant e > 0, no polynomial-time randomized MIWR 
algorithm for k-player combinatorial auctions achieves an expected approximation ratio of 1/k + e, 
unless NPC P/Poly. 

It is worth noting that this impossibility result applies to all universally-truthful randomized 
maximal-in-range algorithms. First, we prove the analogous result for MIWR mechanisms that 
take polynomial advice. 

Theorem 3.2. Fix a regular valuation class C for which 2-player social welfare maximization is 
APX-hard. Fix a constant k > 1. For any constant e > 0, no non-uniform polynomial-time MIWR 
algorithm for k-player combinatorial auctions achieves an expected approximation ratio of 1/k + e, 
unless NPC P/Poly. 

We then complete the proof by showing that any randomized MIWR mechanism can be "de- 
randomized" to one that takes polynomial advice. 

A word is in order on the notion of non-uniform computation. For this, the reader should refer 
to Appendix ID.3I Our hardness results in this section follow from the commonly-held conjecture 
that non-uniform computation cannot solve NP-complete problems, in other words NP ^ P/Poly. 

Our proof strategy is as follows. In Section ETTl we define a "perfect valuation profile" on k players 
as a set of valuations where exactly one player is interested in each item. We then show that any 
range of allocations that gives a good approximation on a randomly drawn perfect valuation profile 
must "shatter" a constant fraction of the items, meaning that the range contains all allocations 
of that subset of the items to q of the players, where the value of q depends on the quality of the 
approximation. (A better approximation implies a larger q.) 

In Section 13.21 we prove Theorem 13.21 by induction on the number of players k. Roughly 
speaking, we show that for any MIWR mechanism A for k players, the allocations with weight 
much larger than 1/k + e are useless. Namely, the inductive hypothesis implies that the allocations 
with weight sufficiently larger than 1/k + e cannot yield a good approximation to a randomly 
drawn perfect valuation; otherwise, one could use the resulting shattered set of items to design a 
strictly better MIWR mechanism for k! players for some k! < k. This allows us to conclude that 
all "useful" allocations have very similar weight to one another; within 1 — rj for arbitrarily small r\ 
and a sufficiently large set of items. Since the mechanism maximizes over a large set of allocations 
that are almost "pure", in the sense that the weights are almost identical, this yields a PTAS, 
contradicting the APX hardness of the problem. 

Finally, we complete the proof of Theorem 13.11 in Section 13.31 using a de-randomization argu- 
ment. This step is similar to Adleman's proof that BPP C P/Poly. 

3.1 Perfect Valuations 

We define a perfect valuation profile as one where each item is desired by exactly one player. 
Perfect valuation profiles will prove useful in our proof, due to the fact that no "small" range can 
well-approximate social welfare for a randomly-drawn perfect valuation profile. 
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Definition 3.3. Let N and M be a set of players and items, respectively. Let V\ : 2 M — > M + be the 
valuation of player i £ N . We say the valuation profile {vi}i^N is a perfect valuation profile on N 
and M if there exists a total allocation S of M to N such that Vi(j) = 1 if j G Si, and Vi{j) = 
otherwise. In this case, we say that {^jjgjv is the perfect valuation profile generated by S. 

To use perfect valuations in our proof, they must be allowable valuations. Indeed, it follows 
immediately from definition 12,11 that any regular class of valuations contains all perfect valuations. 

The key property of perfect valuations is a reinterpretation of Lemma 11.31 and can be sum- 
marized as follows. If a range 7Z of allocations achieves a "good" approximation for many perfect 
valuations, then 1Z must include all allocations of a constant fraction of the items to some set of q 
players. Here, the number of players q depends on the quality of the approximation guaranteed by 
1Z, with a better approximation yielding a larger q. The precise dependence of q on the quality of 
the approximation, as stated in Lemma 11.31 will prove key in Section 13.21 



3.2 Hardness for Non-Uniform MIWR Mechanisms 

In this section, we prove Theorem 13.21 assuming NP % P/Poly. We fix the valuation class C as 
in the statement of the theorem. Moreover, we fix 77 > such that the 2-player social welfare 
maximization problem is APX-hard to approximate within 1 — rj. The proof proceeds by induction 
on k. We need the following strong inductive hypothesis: 

IH(k). For any constant a > 1/k and set T C N, if a non-uniform polynomial-time MIWR 
algorithm for the k-player problem achieves an a -approximation for m items whenever m G T, 
then T is PCD. 

In other words, the set of input lengths for which any particular such algorithm may achieve an 
a-approximation is PCD. (See Section [2.41 for the definition of PCD.) It is clear that establishing 
IH(k) for all k > 1 proves Theorem 13.21 since N is not PCD. The base case of k = 1 is trivial. We 
now fix k, and assume IH(q) for all q < k. 

Assume for a contradiction that IH(k) is violated for some a. Let a > 1/k be the supremum 

To simplify 
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over all values of a violating it. Note that IH(k — 1) implies that a G 
the exposition, we assume the supremum is attained, and fix the algorithm A (and corresponding 
family of polynomial advice strings) achieving an a-approximation for all m G F where F is not 
PCD. Our arguments can all be easily modified to hold when the supremum is not attained, by 
instantiating A to achieve (a — £) instead, where £ > is as small as needed for the forthcoming 
proof. The proof then proceeds as follows. Letting T> m denote the range of A when the number 
of items is m, we partition D m into k sets "D™ (2 < q < k + 1) according to the weight of the 
allocation. We also assign every m G F to one or more subsets T q (2 < q < k + 1); the definition of 
T q is quite technical, but roughly speaking m G T q if the output of ^4, when applied to a random 
perfect valuation profile, has probability at least l/k of being in P™. As we said, F = Uo=2 -^V 
However, we will prove that T q is PCD for all q, hence by Lemma 12.71 their union F is PCD. This 
contradicts our earlier assumption that F is not PCD and completes the proof. 

To prove that T q is PCD, we distinguish three cases depending on the value of q. If 2 < q < k— 1, 
then we prove that m G T q implies that there is a non-uniform polynomial-time MIWR mechanism 
for the g-player problem that achieves an approximation ratio strictly better than 1/q when the 
number of items is \arn \ , for some constant a > 0. By our induction hypothesis, the set of all 
such \arn\ is a PCD set. If q = k, then we proceed similarly but working with the fc-player 
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problem and proving an approximation ratio strictly better than a when the number of items is 
[cm]; once again this implies that the set of all such \crm~] is a PCD set, by our hypothesis on a. 
Finally, if q = k + 1 then we prove that there is a non-uniform polynomial-time algorithm achieving 
approximation ratio 1 — 7/ for the two-player social welfare maximization problem, where r/ was 
chosen so that the problem APX hard to approximate within 1 — t/. By Lemma 12.91 this implies 
T q is PCD. 

Defining the partition of the range. Recall that an MIWR mechanism fixes a range of 
weighted allocations for each m. Let T> m denote the range of A when the number of items is 
m. Let lZ m = {S £ <Y([m], [k]) : (w,S) £ V m for some w} be the corresponding set of pure allo- 
cations. For each allocation S £ 1Z m , we use w(S) to denote the weight of S in D m . We assume 
without loss of generality that there is a unique choice of w(S), since allocations with greater weight 
are always preferred. When m £ F, we may assume without loss of generality that w(S) > a for 
every S £ 1Z m , since A achieves an a approximation for m. We fix e > such that a > 1/k + e, 
and £ > such that l/k + e/2 = (1 — £) • (1/k),, and let 5 = er//5k. We partition lZ m into weight 
classes as follows: 

• K? = {S€K m : < w(S) < flziafezij }, for 2 < q < k - 1. 
. K ™ = {5er : A < w{S ) < {1 _ e ) (k _ 1} } 

• = {S£lZ m :a< w(S) < ^} 

We partition V m similarly: V™ = {(w(S), S) : S € K q } for 2 < q < k + 1. 

Consider now the set V m of perfect valuation profiles on [k] and [m'] = {1, . . . , m/2}, extended 
to [m] by zero-extension. For a given t> S V m and 2 < g < k, let us say that t> S V™ if the set 
7£™ contains an allocation S that achieves at least a (1 + £)(</ — l)/k approximation to the social 
welfare maximizer. Finally, let us say that v G VJ!^_ 1 if v does not belong to VI 71 for any q < k + 1. 
Notice that if 7j V™ then the best approximation ratio achievable using an allocation in T)™ is at 
most 

P + fK'" 1 ) 1 1 -! + !<«. (i) 



fc (l-£ 2 )(g- 1) (l-£) fc 2 

However, by our assumption that A achieves an a-approximation for all valuation profiles with 
m G F, the range P m must contain an a-approximation to the social welfare maximizer. If m £ F 
and t; £ VS_ l5 therefore, it follows that X'S.j must contain an a-approximation to the social welfare 
maximizer. 

By the pigeonhole principle, at least one q satisfies 

|V g m | > \-k m ' . (2) 



Let T q denote the set of all m £ F such that (|2|) holds. By the preceding discussion, we have 

q=2' 



F = Ul±lT q . We now proceed to prove that T q is a PCD set for all q, completing the proof. 



Cases 1 and 2: Large weight classes (q < k). To each allocation S of m items to k players, 
we may associate a function f$ : [m'] — ► [fc] U {*}, that maps each item x £ [m'} to the player who 
receives that item in S, or * if the item is unallocated. Similarly, to each perfect valuation profile 
v on [k] and [m'] we may associate a function f v : [mf] — > [k] that maps each item to the unique 
player who assigns a nonzero valuation to that item. Note that S achieves a c-approximation to the 
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social- welfare-maximizing allocation for v if and only if the functions fs and /„ differ on (1 — c)m' 
or fewer elements of [ml]. 

Assume now that q < k. If m £ T q then at least 1/k fraction of all perfect valuation profiles in 
V™ have an allocation S £ 1Z™ that achieves a (1 + £)(q — l)//c-approximation to the maximum 
social welfare. Thus, for at least 1/k fraction of all perfect valuation profiles v £ VI™, there is 

some S £ 1Z™ such that the fs and /„ differ on ^1 — — ^ q m> elements of [m'\. Applying 

Lemma 11.31 there is a set W of at least \am\ elements of [m'] , and a set N' of q players in [k] , 
such that all allocations of W to N' occur as restrictions of allocations in We refer to If as a 
"shattered" subset of [m'\. 

When q < k (Case 1 of our argument) we may now construct, via a non-uniform polynomial- 
time reduction, an MIWR allocation rule for the g-player problem that achieves a [(1 — £ 2 )q]~ 1 
approximation for \crm~] items when m £ T q . Using W and N 1 - as defined above - as advice, 
embed the instance into an input for A by using players N' and items W in the obvious way: Give 
player in [k] \ N' an all-zero valuation. Moreover, extend the valuation of a player i £ N' to the 
entire set of items [m]. Now, run A on the embedded instance. Notice that every allocation of W 
to N' appears as the restriction of some allocation in i?™, and is therefore in the range of A with 
weight at least [(1 — £ 2 )<7] _1 . Thus, A must output a weighted allocation with expected welfare 
at least [(1 — £ 2 )</] _1 of the optimal. The result is a non-uniform poly-time MIWR mechanism for 
q players with approximation ratio bounded away from 1/q for all integers m = \arn~] such that 
m £ T q . By our induction hypothesis, this implies that the sum of all such m is a PCD set. The 
fact that T q itself is a PCD set now follows as an easy application of the definition of PCD. 

When q = k (Case 2 of our argument) using the same embedding yields an algorithm for k 
players that achieves an a/(l — 5) approximation for all rh = \am\ such that m £ T q . By our 
definition of a, this implies that the set of all such m is a PCD set, which again implies that T q is 
a PCD set. 

Case 3: The smallest weight class (q = k + 1). The remaining case is q = k + 1. When 
m £ Tfc+i, by our definition of V™ +v at least 1/k fraction of all (extended) perfect valuation profiles 
v £ V m have a weighted allocation (w(S),S) £ T>™ +1 that is an a-approximation to the social 
welfare maximizing allocation for v. Since a < w(S) < a/(l — 5), the pure allocation S must be a 
(1 — ^-approximation to the social welfare maximizer. On the other hand, our assumption is that 
maximizing social welfare is APX-hard, even for two players; to be specific, recall that r] > was 
chosen such that it is NP-hard to approximate the maximum social welfare with approximation 
factor 1 — 7). We now complete the proof by exhibiting a randomized, non-uniform polynomial time 
algorithm that achieves a (1 — ^-approximation for the /c-player problem with m/2 items, for all 
m £ Tfc + i. Notice that the de-randomization argument of Adleman [1] for proving BPP C P/Poly 
can be used to de-randomize this to a non- uniform deterministic (1 — /^-approximation for the k- 
player problem with m/2 items, for all m £ Tfc +1 . The reader unfamiliar with Adleman's argument 
may refer to Section 13.31 where we use the argument to establish Theorem 13.11 

Recall that 5 = erj/hk. We will now use A to get a (1 — r/)-approximate solution for an instance 
with k players and m! = m/2 items for all m £ Tk+\ ■ We embed the instance on k players and m! 
items into A in the following way. We use M\ = [m] \ [m 1 ] and let vi : 2 1 — > R denote the resulting 
valuation of player i. We assume without loss of generality that maxj Vi(Mi) = 1. Next, we modify 
each player's valuation function by "mixing in" a perfect valuation profile on the remaining set 
of items M2 = [m'\. We draw a perfect valuation profile (v[, . . . ,v' k ) on N and M2 uniformly at 
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random. Now, we "mix" the original valuations v with v', in proportions 1 and 7 = to yield 
the following hybrid valuation profile v* : 2 — > R + . 

f * = Vi © 7f • 

We abuse notation and use Uj [?;■] to refer also to the zero-extension of v i [v^] to M. Let OPT = 
maxsg^t v(S). Similarly, let OPT' = m&xs^x v' (S) and let OPT* = maxs e x v*(S). Notice that 
1 < OPT < k, and that OPT' = m', by construction. Since v and v' are defined on a disjoint set 
of items, it is easy to see that OPT* = OPT + jOPT'. The scalar 7 was carefully chosen so that 
the following facts hold: 

1. The random valuation profile v' accounts for a majority share of v* in any optimal solution. 
Specifically, jOPT' > ^OPT. This implies that an approximation to the optimal welfare 
using v* gives a similar approximation to the optimal welfare using v'. To be more precise, 
it can be shown by a simple calculation that: 

Claim 3.4. For any S G X and any (3 > 0, ifv*(S) > (30PT* then v'(S) > {(3 - e/2)OPT' . 

2. The original valuation profile v accounts for a constant-factor share of v* in any optimal 
solution. Specifially OPT > -^('yOPT'). This implies that a (1 — <5)-approximation to the 
optimal welfare using v* gives a (1 — 0(5))-approximation to the optimal welfare using v. To 
be more precise, it can be shown by a simple calculation that: 

Claim 3.5. For any S E X, ifv*{S) > (l-S)OPT* thenv(S) > (l-^-8)OPT = (l-rj)OPT. 

We are now ready to show that running A on the valuations v* will yield, with constant proba- 
bility, an allocation that is a (1 — ^-approximation to the optimal welfare for the original valuations 
v , when m £ Tfc +1 . Let {w(S), S) be the weighted allocation output by A; note that S is a random 
variable over draws of v '. Since A is an a approximation algorithm, the welfare w(S)v* (S) is at least 
aOPT* > (l/k + e)OPT* with probability 1. This implies that v*(S) > (gp^ + ^y) OPT*. By 

Claim [331 we see that v'(S) is not too far behind: v'(S) > (^ w ^gy k + — §1 OPT'. Moreover, 
this gives: 

w(S)v'(S) > Q + |) OPT' (3) 

Recall from equation ([T]) that if v' G VS_ 1 then for 2 < q < k, there is no S G 1Z™ that satisfies ([3]), 
hence any such S satisfying ([3]) must belong to T>™ +1 . Also, by our assumption that m G Tj~+i, the 
probability that v' G VjJ]^ is at least 1/k. 

We have thus established that running A on the random input v* yields, with probability at least 
1/k, an outcome (w(S), S) in T>™ +1 . Using the fact that w < a/{l — S) and w(S)v*(S) > aOPT, 
we conclude that S is (1 — 5)-approximate for v* also with probability 1/k: 

v*(S) > (1 - 5)OPT* 

Invoking Claim [3T5| we conclude that v(S) > (1 — r\)OPT with constant probability over draws 
of v' . Since w(S) is at least 1/k, S is output by A with constant probability. This completes the 
proof. 
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3.3 Main Result 



In this section, we complete the proof of Theorem 13. 11 First, we make the observation that running 
a randomized MIWR algorithm multiple times independently and returning the best allocation 
output by any of the runs results in another randomized MIWR algorithm. 

Lemma 3.6. Fix a randomized MIWR algorithm A and a positive integer r. LetA r be the algorithm 
that runs r independent executions of A on its input, and of the r allocations returned, outputs the 
one with greatest welfare. A r is also randomized MIWR. 

Proof. Condition on T>\, . . . ,T> r , the ranges of A on the r independent executions. A maximizes 
expected welfare over T>i on execution i. Therefore A T maximizes over T>\ U • • • U T> r . □ 

Now, we derive Theorem 13.11 from Theorem 13. 2| using a de-randomization argument similar to 
that of Adleman [lj. Assume for a contradiction that A is a randomized MIWR algorithm that 
runs in polynomial time and achieves an expected approximation ratio 1/k + e for each input m and 
v%, . . . ,Vk- Let n denote the number of bits in the input, and let £(n) be a polynomial bounding 
the length of the random string drawn by A. We will describe a polynomial-time with polynomial- 
advice MIWR algorithm that achieves an approximation ratio of 1/k + e/2, which contradicts 
Theorem 13.21 

Let r(n) = 2n/e 2 and let A' = A r( - n) . By Lemma ESI A' is randomized MIWR, runs m 
polynomial time, and draws at most £(n)r(n) random bits. Let Aj be the fraction of the optimal 
social welfare achieved by the allocation output on the i'th run of A. The random variables 
X\, . . . ,X r t n \ are independent, < X; < 1, and i£[Xj] > l/k-\- e. For each input of length n, the 
probability that none of the r(n) runs of A return an allocation with welfare better than 1/k + e/2 
of the optimal can be upper-bounded using Hoeffding's inequality: 



Pr 



max A", < ( - + | 



< Pr 



E 



> 



er(n) 



< e 



-e 2 r(n)/2 



The number of different inputs of length n is 2 n . Thus, using the union bound and the above 
inequality, the probability that A outputs a {1/k + e/2)-approximate allocation on all inputs of 
length n is non-zero. Therefore, for each n there is choice of at most £(n)r(n) random bits such 
that A' achieves a 1/k + e/2 approximation for all inputs. Using this as the advice string, this 
contradicts Theorem 13.21 This completes the proof of Theorem 13.11 



4 Hardness Result for Budgeted Additive Valuations 

In this section, we prove the following theorem: 

Theorem 4.1. There is no polynomial time randomized MIR mechanism that achieves r + e 
approximation of the optimal social welfare for k bidders with budgeted additive valuations, unless 
NP C P/Poly. 

Notice that this theorem implies that all universally truthful randomized MIR mechanisms 
cannot achieve r + e approximation for k bidders. In the proof we will use the term k -partition 
interchangeably with an allocation for k bidders. As in the previous section, an allocation does not 



12 



necessarily allocate all items. A partition corresponding to a total allocation will be called covering. 
Perfect valuations generated by total allocations will also be used in the proof. We first study the 
abundance of "orthogonal" partitions of M = [m]. The following definition formalizes this notion. 

Definition 4.2. Let T be a set of k-partitions of M: T = {(Tf , T\, ■ ■ ■ TV) \ i £ [£]}, we say these 
partitions are e-apart for e > ; if, 



V(7i,/ 2 ,-- - ,I t ) E [k] 



1=1 



U + r)\M\. 



Lemma 4.3. For every pair of integers k and £, and every e satisfying < e < 1, there exists 
a > such that there exists a set F of covering k-partitions of M , where \F\ = e am , and every £ 
elements of F are e-apart. 

The proof of Lemma [4.31 is relegated to the appendix. The next lemma shows that for valuations 
generated by partitions that are apart, good welfare approximations require distinct allocations. 

Lemma 4.4. Given £ covering k-partitions that are e-apart, consider the £ tuples of valuations 
generated by them. The sum of social welfare achievable by a single allocation on these tuples of 

valuations is at most ^ + \J~^f- + ^j^pr^j (1 + e ) °f the optimal. 

Proof. The sum of optimal social welfare for £ generated valuations is easily seen to be lm. Let 

T = Tg, . . . , T^) | i £ [£]} be the set of covering /c-partitions that generate the valuations. 

Let S be the sum of social welfare achieved by one single allocation R, then S is maximized when 

R(x) G argmax ^2 =1 vj(x) holds for every item x £ M. For / G [k] e , define Qi{I) to be the 
ie[fc] 

number of times that i occurs in /, i.e., \{j £ [£] \ Ij = i}\, and define the plenty of I to be 
P(I) = maxj g [fc] Qi(I). Then we have 

s< E • l y A n Tl n ■ ■ ■ n r/j < E/e[ g m (i + e)m. (4) 



ie[k] e 

The second inequality results from the e-apartness of the partitions. 

We recognize that — fe ^ can be seen as the expectation of a properly defined random 

variable — if /' is a random variable uniformly distributed on [k] e , then this factor is exactly the 
expectation of P(I'). The problem boils down to bounding E[P(I')]. Note that E[Qi(I')\ = £/k. 
Let Y{T) = P{I) — t, then by the union bound 

Pr[Y(l') >5-^]<k- PrlQdl') > (1 + <*)-]• 

Applying Chernoff bound (Theorem IB. ip . we get 

f°° £ f°° / k\ £ / k\ 

E[Y{I')\ = ^ Pr r [Y(I') > 6} d5 = - J Pr P [Y(l') > [6 ■ jj -] d ^ • - J 

f r 2e ~ l £ r°° £ ~) 

< £^J^ Pr P [Qi(I') > (l + 5)-]d5 + j^ Pr I ,[Q i (I')>(l + S)-]d6j 

< £ e- sH ' ik d5 + 2- 5 " k dd^j = + 
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Consequently we also obtain that E[P(I')] < | + yk r a£ H — • Substituting this into ([!]), then 
dividing it by £m, the sum of optimal social welfare, we get what the lemma claims. □ 

To finish the proof, we need the next lemma that connects to the "shattering" lemma. 

Definition 4.5. Two k-partitions (Ti, T 2 , • • • , T^) and (T[, T 2 , • • • , TjQ are said to be e-far ifYli^j 1^ 
Tj\ > em. If two partitions are not e-far, we say that they are e-close. 

1 i / kit | ke~ l / k 



n 



Lemma 4.6. // an MIR mechanism achieves at least ^ + y + £. ln2 + e' approximation to the 
optimal social welfare for k bidders, where k, £ and e 1 are all fixed, and £ > Wk, then there is a 
5 > 0, such that there is a subset S of items, with \S\ > 6m, and two bidders i and j, and every 
allocation of items in S to i and j is a restriction of an allocation in the range of the mechanism. 

Proof. Let e be e'/3, and by Lemma 14.31 there is a set F of e-apart /c-partitions, and \F\ = e a ^ u ^ 
for some a > 0. Let 7Z be the multi-set of allocations output by the mechanism on the tuples of 
valuations generated by the partitions in F. Note that \7Z\ = \F\. We claim that in 7Z, there can be 
no £ partitions such that every two of them are ^--close. For a contradiction, suppose that this is 
the case. Let {{T{,T l 2 , ■■■ ,T l k )\i £ [£}} be these allocations, define D to be Ui< s <t<^ U^jC^nTj), 
then because of the pairwise ^--closeness of the partitions, \D\ < em. For each item not in D, the 
I allocations either allocate it in the same way, or some allocate it in the same way and others 
do not allocate it to any bidder. By Lemma 14.41 on M\D the allocations can achieve at most 

k + \ I -j- + 2 , ln2 + e of the sum of optimal welfare. Each item in D can contribute at most I to the 
sum of welfare, and in total they count at most e fraction of the optimal, which is im. Thus the 
mechanism can achieve at most ^ + \J~^f- + k £.\ n 2 + nf~ °f the optimal social welfare, contradicting 
the assumption on its performance. Thus, there are no ^-allocations in TZ that are pairwise ^-far. 
Applying Lemma 11.41 to TZ, we finish the proof. □ 



Proof of Theorem \4-l\ "- Whenever we have the range of a mechanism containing all allocations of 
items in a linearly smaller subset to two bidders, we can use the mechanism with polynomial advice 
to optimize the social welfare of an auction with fewer items. Therefore, the condition of Lemma f4.6l 
should not be satisfied for any £ unless NP C P/Poly. Let £ in Lemma 14.61 get arbitrarily big. We 
see that, unless NP C P/Poly, any efficient MIR mechanism cannot achieve 1/k + e approximation 
to the optimal social welfare for k bidders. Then by the same argument as in Section 13.31 (proof 
omitted here), we can extend this to randomized MIR mechanisms and get Theorem 14. 1L 

□ 
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A Shattering Results 



We first formally define the notion of "shattering" in a more general setting. 

Definition A.l. For any sets U, V we interpret the notation V u to mean the set of functions 
from U to V. V u , S C U, L C V , we say that S is (L,q)- shattered by R, for an integer q, 

2 < q < \L\, if there exist q functions c±, C2, . . . , c q : S — > L that satisfy: 

1. Vx G S Vi 7^ j Cj(x) 7^ Cj(x) 

2. V/i G [g] 5 3/ € i? Vx G S /(x) = c h(iB) (x) 

Intuitively, we associate with each element in 5 a range in L of size exactly (/, and we say that 
S is (L, g)-shattered by i? if every function that maps each element in S to its associated range 
is a restriction of an element in R. In the context of combinatorial auctions, we see U as the set 
of items, and V as the set of bidders, plus a dummy bidder representing not allocating the item. 
Then set of functions V u is the set of all possible allocations. 

The following observation bridges this notion of shattering to its application to the combinatorial 
auctions in the paper. 

Observation A. 2. If a subset S of size 5m is (L,q)- shattered by R C V u , then there exists a 
subset I! C L and S' C S, such that \L'\ = q, \S'\ > \S\/(^) and S' is (L' ,q)- shattered by R. 

The observation is easily seen by the pigeonhole principle. Note that by the definition of (L, q)- 
shattering, if \L'\ = q, then we have that every function from S' to V is a restriction of an element 
in R. In the context of combinatorial auctions, this means that all possible allocations of items in S' 
to the q bidders in V are in the range R under restriction. It is this form of "strong" shattering 
that is in use in the main body of the paper. In the following lemmas, we will show the existence 
of large (L, g)-shattered sets, being aware that an application of the above observation implies a 
subset being "strongly" shattered, of size only a constant factor smaller. 

Lemma A. 3. For every integer n > 2, q, 2 < q < n, and every e > 0, there is a 5 > such 
that the following holds. For every pair of finite sets M,N with \N\ = n and every set R of more 
than (q — 1 + e)' M ' elements of N M there is a set S of at least 8\M\ elements of M such that S is 
(V,q)- shattered by R. 

Proof. Let F q (m, n, d) denote the maximum cardinality of a set R C A B such that \A\ = n, \B\ = m, 
and R does not (A, g)-shatter any (d + l)-element subset of B. 

Fix an element b € B. For each element / G R, let denote the restriction of / to the 
set B\{b}. Take the set of all functions g : B\{b} — ► A and partition it into sets Qq, Qi, - ■ ■ , Qrn\ 

as follows. First, given an ordered pair (g, a) consisting of a function g from -B\{6} to A and an 
element a G A, let g * a denote the unique function / from B to A that maps b to a and restricts 
to g on B\{b}. Now define S(g) to be the set of all a G A such that g * a is in R. Number all the 
g-element subsets of A from 1 to (™), call them Pi,P2,--- ,P(n\, and let Qi (1 < i < (")) consist 

of all g such that S(g) has at least q elements, and the q smallest elements of S(g) constitute Pi. 
Finally let Qq consist of all g such that S(g) has fewer than q elements. 

By our assumption that R does not (A, c/)-shatter any set of size greater than d, we have the 
following facts: 
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1. Qo does not (A, g)-shatter any (d + l)-element subset of B \ {&}. Consequently, 



|Qo| <F(m-l,n,d). 

2. For all i < (™), Qi does not (A, g)-shatter any d-element subset of B \ {&}. Consequently, 

\Qi\ <F q (m-l,n,d-l). 

Let Ri denote the set of all / G R such that /_& is in Qi , for < % < (™) , then by definition of 
Qi, we have |i?o| < (<Z — l)|Qo|) and |i2j| < n\Qi\ for i < 1. Since R^s are disjoint, we have 

\R\=^2\Ri\ <(?-l)|Qo|+ 

i=0 i=l 

F q (m, n, d) < (g — l)F g (m — l,n, + ^F g (m— l,n,d— 1) (5) 

The recurrence ([5]), together with the initial condition F q (m, n, 0) = (q— l) m for all m, n, implies 
the upper bound 

d 



F q (m,n,d) K^^J 



i=0 

Thus, if Fq(m, n,d) > (q — 1 + e) m then, by using Stirling's approximation, we see that d > 5m for 
some 5 depending only on e and n. □ 

In Section [3] of the paper, we made use of the fact that a range of allocations shatters a large 
subset if they generate good social welfare for many perfect valuations. The condition is captured 
by the following definition: 

Definition A. 4. For two functions f,g£ N , their normalized Hamming distance Ham(/, g) is 
equal to times the number of distinct x G M such that f(x) ^ g{x). If f £ N AI and R C N M , 
the Hamming distance Ham(/, R) is the minimum ofH&m(f,g) for all g £ R. 

As each perfect valuation can be seen as a function / in N M , and each allocation can be viewed 
as a g G N M , Ham(/, g) is how much social welfare is lost by g on the perfect valuation /. In 
the same way, R can be viewed as a range of allocations, and Ham(/, R) is the minimum social 
welfare lost by any of the allocation in R on valuation /. If Ham(/, R) is small for a large fraction 
of / € N M , it means the range achieves a good approximation of social welfare for a significant 
portion of the perfect valuations. 

We also note that since iV can represent the set of bidders plus a dummy bidder representing not 
allocating an item, 

N M 

can express all allocations including those not allocating all items. On the 
other hand, if we restrict the functions so that they can take values only in a subset L representing 
the real bidders, then they represent allocations that do not discard items. This explains the role 
played by the set L in the next lemma. 

Lemma A. 5. For every positive real number e > 0, integers n > 2, q, 2 < q < n, and polynomial 
7(n), there is a 6 > such that the following holds. For all finite sets M, N and all subsets L C N 
with \L\ = n, if R C N M and at least 7n' f/ ' points f G iF satisfy Ham(/, R) < 1 — (q — l)/n — e, 
then there is a set S C M such that \S\ > S\M\ and S is (L,q)- shattered by R. 
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Proof. Let m = \M\,r = 1 — (q — l)/n — e. Let ^4 be the set of all points / G L M such that 
Ham(/, i?) < r. Let G be a function from A to R such that Ham(/, G(f)) < r for all / G A. 
Let /(/) denote the set of all x G M such that f{x) = G{f){x). Note that our assumption 
that Ham(/, G(f)) < r implies that |/(/)| > (^r- + e)m. The number of pairs (/, J) such that 
f £ A, \ J\ = em/2, J C J(/) is bounded below by 7re m • ( ^m™")- By the pigeonhole principle, 

there is at least one set J of em/2 elements such that the number of / € L satisfying J C /(/) is 
at least 

7nm . , + e)m>) / ( m J = ^ ((^ + *)m)! ((1 - e/2)m)I 

^i + e)m (a=l + e )m-l (2=i + e/2)m 



em/2 ;/ ((^i + e/2)m)! m! 

> 7n" 



> 7n" 



m m — 1 (1 — e/2)m 



1 - e/2 



Fix such a set J. For every / G L M satisfying J C /(/), the restriction of / to J is an element 
g G L J ; note that 5 is also the restriction of G(f) to J. For any single g G L^, the number of 
/ G L M that restrict to g is bounded above by n m - em / 2 . Applying the pigeonhole principle again, 
we see that the number of distinct g G L J that occur as the restriction of some / G A satisfying 
J ^ /(/) must be at least 

7n m ( ^T+ e l 2 \ 6m/2 I n m-em/2 _ „ Y 9 ~ 1 + e"/ 2 ^ 



I -e/2 J / ' V l-e/2 

We now have the following situation. There is a set J of em/2 elements, and at least j-(q— l+en/2)'*^ 
elements of L J occur as the restriction of an element of R to J. It follows from Lemma IA.3I that J 
has a subset of 5 of at least 5m elements such that S is (L, g)-shattered by R. □ 

Proof of Lemma \1.5k Combining Lemma IA.31 Lemma IA.5I and Observation IA.2|, we immediately 
get Lemma 11.31 □ 

Now we are ready to show the next shattering lemma. The /c-partitions represent allocations 
to /c-bidders, allowed to discard items. In the proof we occasionally see them as partial functions, 
in a way very similar to that in the previous lemmas. 

To state the lemma succinctly, we denote by t(k,£,e,m,r) the smallest number of subsets that 
are ([&], 2)-shattered by any set T of ^-partitions of a set M, where \M\ = m, \T\ = r, and every £ 
partitions from T are not pairwise e-close (see Definition 14. 5p . 

Lemma A. 6. For every integers k > 2, £ and m, every e > 0, there exists an a > such that 
t(k, £, e, m, r) > r a for every r. 

Note that if r is 2 /3m for some (3 > 0, the conclusion implies the existence of a subset of size 
7m that is ([k], 2)-shattered by the set of partitions, for some 7 > 0. The proof also works if R is 
a multi-set. 
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Proof. Let T be any set of ^-partitions of M, \M\ = m, \T\ = p, and every £ elements from T 
are not pairwise e-close. We arbitrarily group the partitions in T , so that every group consists of 
£ partitions. Then in each group {(Tf,^, • • • ,T^) \ i £ [£]}, there are at least two partitions that 
are e-far, and the size of their "difference" Yltyj 1^7 ^ Tj\ ^ s a ^ least em. Since we have rj£ such 
pairs, the sum of the sizes of "differences" will be at least ^j^. By pigeonhole principle, there exists 
an x £ M, and i* , j* £ [k] (i* ^ j*) such that in at least -f^ pairs of partitions (7\,T2, • • • , 3\) 

and (T{,T2, ■ ■ ■ -,T' k ), x occurs in (Tj* n Tj») U (T/» n Tj*). Now if we denote by %* the set of those 
partitions in T that map xto i*, and Tj* those mapping x to j* , then \%* \ > jp^- and \Tj*\ > ttft- 

Let Ii* denote the set of subsets that are ([k], 2)-shattered by %*, and similarly Ij* the set of 
subsets ([&], 2)-shattered by Tj*, I the set of subsets ([k], 2)-shattered by T itself. We claim that 
1^1 > \h* I + \ Ij* I • To see this, it is clear that ij* U Ij* C /, and x is not in any of the set in ij* U /,* . 
Besides, for every set S in Ij* n Ij*, S U {x} should be shattered by T according to our definition. 
Therefore \I\ > |ij* U Ij*\ + |Ij* f)Ij*\ = \Ii* \ + \Ij*\- In other words, t(k, e,m,r) > 2t(k, e, m, ttft)- 

By induction the lemma is proved. □ 
Proof of Lemma \l-4\ ' Combining Lemma IA.6I and Observation IA.21 we get Lemma 11.41 □ 
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B Omitted Proofs from Section [4] 



Proof of Lemma \4.3[ - This is shown by a probabilistic argument. We randomly sample a number of 
covering fc-partitions in the following way. Each time we sample a partition, we decide for each item 
in M, uniformly at random, which one of the k subsets it should be placed in. We repeat this process 
n times, and get a set of /c-partitions {(T^Tr,, • • • , T^) | i 6 [n]}. Let A = {ai,ci2, ■ ■ ■ , a?} C [n], 
B = {&i, 62, • ' ' ; be} G [k] , let l\ denote the event 




The expectation of the left hand side of ([6]) is m/k^. By Chernoff bound, 

Pr[lf\ < e~ e2m / 4k \ VA,B. 
The probability that 1^ happens for some A and B is upper bounded by 

AC[n],\A\=£Be[kY ^ ' ^ ' 

Therefore as long as n < A. e e2m / 4eke ^ the probability above is smaller than 1, i.e., there exist 
n partitions that satisfy the lemma. This completes the proof. □ 

In the proof of Lemma \AA\ we used two forms of the Chernoff bound: 

Theorem B.l. (Chernoff bound): Let X±, X2, ■ ■ ■ ,X n be i.i.d. random variables such that Xi 6 
{0, 1} and Pr(Xi = 1) = p for every i £ [n]. Let X = £\ Xi and /i = then 

(i) for 5 > 2e - 1, Pr[X > (1 + S)fj] < 2~ s »; 

(ii) for < 5 < 2e - 1, Pr[X > (1 + %] < e" 5 ^/ 4 . 
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C Omitted Proofs from Section 12.4 



Proof of Lemma \2~T\ Suppose S\, . . . , Sk are CD sets, with circuit families {Cn } (1 < i < k) such 
that C$ has size bounded by a polynomial qi(n) and decides 3SAT correctly on all instances of size 
n G Si. Let q{n) be a polynomial satisfying q(n) > maxi<j<fc %(n) for all n G N. We can obtain a 
family of circuits {C n } of size bounded by q(n), by defining C n to be equal to C„ if n belongs to S*j 
but not to S±, ■ ■ ■ , S{-i, and defining C n to be arbitrary if n £ Si U • • • U Then C n decides 3SAT 
correctly on all instances of size n G 5i U • • • U Sk, as desired. 

If S\, . . . ,Sk are CD sets, pi, ■ ■ ■ ,Pk are polynomials, and for 1 < z < fc we have a PCD set 
?i C UneS [ n >^( n )]' then we may take p(n) to be any polynomial satisfying p(n) > maxi<j<fc j>j(ra) 
for all n G N, and we may take 5 to be the set SiU- • -US^. Then we find that the set T = TiU- • -UT^ 
is contained in Unes[ n >P( n )]- This implies that T is PCD, because S is CD. □ 

Proof of Lemma \2.9c By our assumption that C is NP-hard under polynomial-time many-one 
reductions, there is such a reduction from 3SAT to C Since the running time of the reduction is 
bounded by a polynomial p(n), we know that it transforms a 3SAT instance of size n into an C 
instance of size at most p(n). Assume without loss of generality that p(n) is an increasing function 
of n. 

Let S be the set of all n such that {p(n) + l,p(n) + 2, . . . ,p(n + 1)} intersects T. The set 
S is complexity-defying, because for any n G S we can construct a polynomial-sized circuit that 
correctly decides 3SAT instances of size n, as follows. First, we take the given 3SAT instance and 
apply the reduction from the preceding paragraph to transform it into an C instance of size at 
most p(n). Then, letting m be any element of T n {p(n) + 1, . . . ,p(n + 1)}, we apply the padding 
reduction to transform this C instance into another C instance of size m. Finally, we solve this 
instance using a circuit of size poly(m) that correctly decides C on all instances of size m; such a 
circuit exists by our assumption on T. 

For every m G T there is an n G N such that p(n) < m < p{n + 1), and this n belongs to S. 
Thus, T C [] neS [n,p(n + 1)], and this confirms that T is PCD. □ 

Proof of Lemma [2. 1 Ck Suppose that 

NC |J [n,p{n)\ (7) 

neS 

for some complexity-defying set S and polynomial function p(n). We may assume without loss of 
generality that p(n) is an increasing function of n and that p(n) > n for all n. 

Suppose that {C n } is a polynomial-sized circuit family that correctly decides 3SAT whenever 
the input size is in S. We will construct a polynomial-sized circuit family that correctly decides 
3sat on all inputs. The construction is as follows: given an input size m, using (JT|) we may find 
a natural number n such that n < p(m) < p(n). Since p is an increasing function, we know that 
n > m. Given an instance of 3SAT of size m, we first adjoin irrelevant clauses that don't affect its 
satisfiability — e.g. the clause (iVi) — until the input size is increased to n. This transformation 
can be done by a circuit of size poly(m), since n < p{m). Then we solve the new 3SAT instance 
using the circuit C n . By our assumption on S, this correctly decides the original 3SAT instance of 
size m. As m was arbitrary, this establishes that NP C P/ poly, as desired. □ 
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D Additional Preliminaries 



D.l Truthfulness 

A /c-bidder, m-item mechanism for combinatorial auctions with valuations in C is a pair (f,p) where 
/ : C^ n — ► ^([m], [k]) is an allocation rule, and p = (pi, • • • where pi : — > R is a payment 
scheme. (f,p) might be either randomized or deterministic. 

We say deterministic mechanism (f,p) is truthful if for all i, all Vi,v[ and all v-i we have that 
Vi(f(vi,v-i)i)—pi(vi,V-i) > v'^fiv'^ v-i)i)— piv'^ V-i). A randomized mechanism (/, p) is universally 
truthful if it is a probability distribution over truthful deterministic mechanisms. More generally, 
(f,p) is truthful in expectation if for all i, all Vi,v[ and all V-i we have that E[vi(f(vi, i>-i)i) — 
> V-iji) —pitv'frV-i)], where the expectation is taken over the internal random 

coins of the algorithm. 

D.2 Algorithms and Approximation 

Fix a valuation class C. An algorithm A for combinatorial auctions with C valuations takes as input 
the number of players k, the number of items m, and a player valuation profile v\, . . . ,Vk where 
Vi G C m . A must then output an allocation of [m] to [k]. For each and m, A induces an allocation 
rule of m items to k bidders. Our approximation bounds are all in terms of the number of players. 
Therefore, in our proofs we consider combinatorial auctions with a fixed number of bidders k. 

We say an algorithm A for A;-player combinatorial auctions achieves an a- approximation if, for 
every input m and v\ , . . . ,Vk- 

E[v(A(m,vi,...,Vk))]>a max v(S) 

SeX([m],[k]) 

Moreover, we say.4 achieves an a- approximation for m items if the above holds whenever the 
number of items is fixed at m. 

D.3 A Primer on Non-Uniform Computation 

Non-uniform computation is a standard notion from complexity theory (see e.g. [3]). We say an 
algorithm is non- uniform if it takes in an extra parameter, often referred to as an advice string. 
However, the advice string is allowed to vary only with the size of the input (i.e. with m). Moreover, 
the length of the advice string can grow only polynomially in the size of the input. If a problem 
admits a non-uniform polynomial-time algorithm, this is equivalent to the existence of a family 
of polynomial-sized boolean circuits for the problem. When we say a non-uniform algorithm is 
polynomial-time MIWR, we mean that the algorithm runs in time polynomial in m, and maximizes 
over a weighted range, regardless of the advice string. When we say a non-uniform algorithm 
achieves an approximation ratio of a on m, we mean that there exists a choice of advice string for 
input length m such that the algorithm always outputs an a-approximate allocation. 
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